Monocular 3D Face Reconstruction with Joint 2D and 3D Constraints
نویسندگان
چکیده
3D face reconstruction from a single image is challenging problem, especially under partial occlusions and extreme poses. This because the uncertainty of estimated 2D landmarks will affect quality reconstruction. In this paper, we propose novel joint optimization method to adaptively reconstruct shapes image, which combines depths solve uncertain detections invisible landmarks. The strategy our involves two aspects: coarse-to-fine pose estimation using both landmarks, an adaptive re-weighting based on refined parameters recover accurate faces. Experimental results multiple datasets demonstrate that can generate high-quality color robust for self-occlusions large
منابع مشابه
Simultaneous Monocular 2D Segmentation, 3D Pose Recovery and 3D Reconstruction
We propose a novel framework for joint 2D segmentation and 3D pose and 3D shape recovery, for images coming from a single monocular source. In the past, integration of all three has proven difficult, largely because of the high degree of ambiguity in the 2D 3D mapping. Our solution is to learn nonlinear and probabilistic low dimensional latent spaces, using the Gaussian Process Latent Variable ...
متن کاملJoint Face Alignment and 3D Face Reconstruction
We present an approach to simultaneously solve the two problems of face alignment and 3D face reconstruction from an input 2D face image of arbitrary poses and expressions. The proposed method iteratively and alternately applies two sets of cascaded regressors, one for updating 2D landmarks and the other for updating reconstructed poseexpression-normalized (PEN) 3D face shape. The 3D face shape...
متن کامل3D Face Reconstruction with Silhouette Constraints
In this paper we introduce silhouette constraints to improve the quality of unconstrained 3D face reconstruction. Previously, state of the art unconstrained 3D face reconstruction techniques relied solely on photometric consistency and matching sparse facial landmarks. We show that constraining the silhouettes of the 3D reconstruction to match silhouettes in the input images can further improve...
متن کاملJoint Semantic Segmentation and 3D Reconstruction from Monocular Video
We present an approach for joint inference of 3D scene structure and semantic labeling for monocular video. Starting with monocular image stream, our framework produces a 3D volumetric semantic + occupancy map, which is much more useful than a series of 2D semantic label images or a sparse point cloud produced by traditional semantic segmentation and Structure from Motion(SfM) pipelines respect...
متن کاملJoint Face Alignment and 3D Face Reconstruction with Application to Face Recognition
Face alignment and 3D face reconstruction are traditionally accomplished as separated tasks. By exploring the strong correlation between 2D landmarks and 3D shapes, in contrast, we propose a joint face alignment and 3D face reconstruction method to simultaneously solve these two problems for 2D face images of arbitrary poses and expressions. This method, based on a summation model of 3D face sh...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-20497-5_11